arXiv:l502.07463v4 [math.ST] 19 Mar 2015 


On objective and strong objective 
consistent estimates of unknown 
parameters for statistical structures in a 
Polish group admitting an invariant 

metric 

Murman Kintsurashvili* 

Tengiz Kiria^ and Gogi PantsulaW 

Department of mathematics, Georgian Technical University, 

Kostava Street. 77 , Tbilisi DC 0175, 

Republic of Georgia 

e-mail: m.kintsurashvili@gtu.ge; t.kiria@gtu.ge; g.pantsulaia@gtu.ge 


Abstract: By using the notion of a Haar ambivalent set introduced by 
Balka, Buczolich and Elekes (2012), essentially new classes of statistical 
structures having objective and strong objective estimates of unknown pa¬ 
rameters are introduced in a Polish non-locally-compact group admitting 
an invariant metric and relations between them are studied in this paper. 
An example of such a weakly separated statistical structure is constructed 
for which a question asking ” whether there exists a consistent estimate of 
an unknown parameter ^ is not solvable within the theory ( ZF ) & (DC). 
A question asking ” whether there exists an objective consistent estimate of 
an unknown parameter for any statistical structure in a non-locally com¬ 
pact Polish group with an invariant metric when subjective one exists ” is 
answered positively when there exists at least one such a parameter the 
pre-image of which under this subjective estimate is a prevalent. These 
results extend recent results of authors. Some examples of objective and 
strong objective consistent estimates in a compact Polish group {0; 1}^ 
are considered in this paper. 
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1. Introduction 

In order to explain a big gap between the theory of mathematical statistics and 
results of hypothesis testing, concepts of subjective and objective infinite sample 
consistent estimates of a useful signal in the linear one-dimensional stochastic 
model were introduced in [18] . This approach essentially uses the concept of Haar 
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null sets in Polish topological vector spaces introduced by J.P.R. Christensen 

[ 2 ]- 

The Polish topological vector space R" Y of all real-valued sequences (equiva¬ 
lently, of infinite samples) equipped with Tychonoff metric plays a central role in 
the theory of statistical decisions because a definition of any consistent estimate 
of an unknown parameter in various stochastic models without infinite samples 
is simply impossible. 

Let explain from the point of view of the theory of Haar null sets in R w some 
confusions which were described by Jum Nunnally [14] and Jacob Cohen [4]: 

Let x \, X 2 , • • • be an infinite sample obtained by observation on independent 
and normally distributed real-valued random variables with parameters (0,1), 
where 0 is an unknown mean and the variance is equal to 1. Using this infinite 
sample we want to estimate an unknown mean. If we denote by f.ig a linear 

_ . . , O-0) 2 

Gaussian measure on R with the probability density y=e 2 , then the 

triplet 

(R w , B(R n ), pff )e&R (LI) 

stands a statistical structure described our experiment, where ^(R^) denotes 
the a -algebra of Borel subsets of R jV . By virtue of the Strong Law of Large 
Numbers we know that the condition 

\ t n 

Pe {{{xk)k£N ■ {xk)kGN e R n & lim — k=1 Xk = 0} = 1 (1.2) 

n—> 00 77 , 

holds true for each 0 £ R. 

Take into account the validity of (1.2), for construction of a consistent infinite 
sample estimation of an unknown parameter 0 a mapping T defined by 

T((x k )kGN) = lim (1.3) 

n—»■ 00 Tl 

is used by statisticians. As usual, null hypothesis significance testing in the case 
Hq : 9 = 9 0 assumes the following procedure: if an infinite sample (xk)k&N £ 
T -1 (0o) then Hq hypothesis is accepted and Hq hypothesis is rejected, other¬ 
wise. There naturally arises a question asking whether can be explained Jacob 
Cohen statement [4]: ”... Dont look for a magic alternative to NHST [null hy¬ 
pothesis significance testing] ... It does not exist.” Notice that a set S of all 
infinite samples ( Xk)keN for which there exist finite limits of arithmetic means 
of their first n elements constitutes a proper Borel measurable vector subspace 
of R^. Following Christensen [2] , each proper Borel measurable vector subspace 
of an arbitrary Polish topological vector space is Haar null set and since S' is a 
Borel measurable proper vector subspace of R Y we claim that the mapping T is 
not defined for ’’almost every”(in the sense of Christensen 1 [2]) infinite sample. 
The latter relation means that for ’’almost every” infinite sample we reject null 

1 We say that a sentence P(-) formulated in term of an element of a Polish group G is 
true for "almost every” element of G if a set of all elements g £ G for which P(g) is false 

constitutes a Haar null set in G. 






M.Kintsurashvili, T.Kiria, G.Pantsulaia/On objective and strong objective consistent estimated 


hypothesis Hq. This discussion can be used also to explain Jum Nunnally’s [14] 
following conjecture: ”If the decisions are based on convention they are termed 
arbitrary or mindless while those not so based may be termed subjective. To min¬ 
imize type II errors, large samples are recommended. In psychology practically 
all null hypotheses are claimed to be false for sufficiently large samples so ... it 
is usually nonsensical to perform an experiment with the sole aim of rejecting 
the null hypothesis”. 

Now let Tj : H N —> R be another infinite sample consistent estimate of an 
unknown parameter 6 in the above mentioned model, i.e. 

1$ ({(^fc)fceiv : {%k)k£N £ & Ti((xk)keN) = 6}) = 1 (1-4) 

for each 9 g R. Here naturally arises a question asking what are those addi¬ 
tional conditions imposed on the estimate Tj under which the above-described 
confusions will be settled. 

In this direction, first, notice that there must be no a parameter 9q £ R 
for which Tf 1 (9f) is Haar null set, because then for ’’almost every” infinite 
sample null hypothesis Hq : 9 = 9q will be rejected. Second, there must be 
no a parameter 9\ £ R for which Tf l (9\) is a prevalent set (equivalently, a 
complement of a Haar null set) because then for ’’almost every” infinite sample 
null hypothesis Hq : 9 = 02 will be rejected for each 02 ^ 0i- This observations 
lead us to additional conditions imposed on the estimate T± which assumes 
that Tf l (9) must be neither Haar null nor prevalent for each 9 £ R. Following 
[1], a set which is neither Haar null nor prevalent is called a Haar ambivalent 
set. Such estimates firstly were adopted as objective infinite sample consistent 
estimates of a useful signal in the linear one-dimensional stochastic model(see, 
[27], Theorem 4.1, p. 482). 

It was proved in [27] that T n : R” —> R (n £ N ) defined by 

T n (x !,■•• ,x n ) = —F~ 1 (n~ 1 #({x 1 , ■ ■ ■ ,x n }D(-oo;0])) (1.5) 

for (xi, ■ ■ ■ ,Xn) £ R", is a consistent estimator of a useful signal 9 in one¬ 
dimensional linear stochastic model 

£fc = 0 + A k (k £ N), (1-6) 

where #(•) denotes a counting measure, A k is a sequence of independent iden¬ 
tically distributed random variables on R with strictly increasing continuous 
distribution function F and expectation of Ai does not exist. In this direction 
the following two examples of simulations of linear one-dimensional stochastic 
models have been considered. 

Example 1.1. ( [27], Example j.l, p. Since a sequence of real numbers 
(tt x n — [n x n]) n eN, where [•] denotes an integer part of a real number, is 
uniformly distributed on (0,1 )(see, [10], Example 2.1, p.l7), we claim that a 
simulation of a iyequidistributed sequence ( x n ) n <M on R( M is a ’’suffi¬ 
ciently large” natural number and depends on a representation quality of the 
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Table 1 

Estimates of the useful signal 6=1 when the white noise is standard Gaussian random 

variable 


n 

T n 

Xn 

n 

T n 

X n 

50 

0.994457883 

1.146952654 

550 

1.04034032 

1.034899747 

100 

1.036433389 

1.010190601 

600 

1.036433389 

1.043940988 

150 

1.022241387 

1.064790041 

650 

1.03313984 

1.036321771 

200 

1.036433389 

1.037987511 

700 

1.030325691 

1.037905202 

250 

1.027893346 

1.045296447 

750 

1.033578332 

1.03728633 

300 

1.036433389 

1.044049728 

800 

1.03108705 

1.032630945 

350 

1.030325691 

1.034339407 

850 

1.033913784 

1.037321098 

400 

1.036433389 

1.045181911 

900 

1.031679632 

1.026202323 

450 

1.031679632 

1.023083495 

950 

1.034178696 

1.036669278 

500 

1.036433389 

1.044635371 

1000 

1.036433389 

1.031131694 


irrational number it), where denotes a 9-shift of the measure fi defined by 

distribution function F, can be obtained by the formula 

x n = -Fg~ 1 ( 7r x n — [n x n\) (1.7) 

for n < M and 9 € R, where Fg denotes a distribution function corresponding 
to the measure pg. 

In this model, 9 stands a ’’useful signal”. 

We set: 

(i) n - the number of trials; 

(ii) T n - an estimator defined by the formula (1-5); 

(Hi) X n - a sample average. 

When F[x) is a standard Gaussian distribution function, by using Microsoft 
Excel we have obtained numerical data placed in Table 1. Notice that results of 
computations presented in Table 1 show us that both statistics T n and X n give 
us a good estimates of the ’’useful signal” 9 whenever a generalized ’’white noise” 
in that case has a finite absolute moment of the first order and its moment of 
the first order is equal to zero. 

Now let F be a linear Cauchy distribution function on R, i.e. 

p {x) = [ , \m dt & G R 1 ( L8 ) 

J-oo n 1 + t 2 ) 

Numerical data placed in Table 2 were obtaining by using Microsoft Excel 
and Cauchy distribution calculator of the high accuracy [8]. On the one hand, 
the results of computations placed in Table 2 do not contradict to the above 
mentioned fact that T n is a consistent estimator of the parameter 9=1. On the 
other hand, we know that a sample average X n does not work in that case because 
the mean and variance of the ’’white noise ”(i.e., Cauchy random variable) are 
not defined. By this reason attempts to estimate the ’’useful signal” 9 = 1 by 
using the sample average will not be successful. 

In [27] has been established that the estimators limT„ := inf„ sup m>n T m 
and lim Th := sup n inf m > n T m are consistent infinite sample estimates of a useful 
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Table 2 

Estimates of the useful signal 6 = 1 when the white noise is Cauchy random variable 


n 

T n 

x n 

n 

T n 

x n 

50 

1.20879235 

2.555449288 

550 

1.017284476 

41.08688757 

100 

0.939062506 

1.331789564 

600 

1.042790358 

41.30221291 

150 

1.06489184 

71.87525566 

650 

1.014605804 

38.1800532 

200 

1.00000000 

54.09578271 

700 

1.027297114 

38.03399768 

250 

1.06489184 

64.59240343 

750 

1.012645994 

35.57956117 

300 

1.021166379 

54.03265563 

800 

1.015832638 

35.25149408 

350 

1.027297114 

56.39846672 

850 

1.018652839 

33.28723503 

400 

1.031919949 

49.58316089 

900 

1.0070058 

31.4036155 

450 

1.0070058 

44.00842613 

950 

1.023420701 

31.27321466 

500 

1.038428014 

45.14322051 

1000 

1.012645994 

29.73405416 


signal 9 in the model (1.6) (see, [27], Theorem 4.2, p. 483). When we begin to 
study properties of these infinite sample estimators from the point of view of 
the theory of Haar null sets in R ff , we observed a surprising and an unexpected 
fact for us that these both estimates are objective (see, [20], Theorem 3.1). 

As the described approach naturally divides a class of consistent infinite sam¬ 
ple estimates into objective and subjective estimates shouldn’t seem excessively 
highly told our suggestion that each consistent infinite sample estimate must 
pass the theoretical test on the objectivity. 

The present manuscript introduces the concepts of the theory of objective 
infinite sample consistent estimates in RA and gives its extension to all non- 
locally-compact Polish groups admitting an invariant metric. 

The rest of this note is the following. 

In Section 2 we give some notions and facts from the theory of Haar null sets in 
complete metric linear spaces and equidistributed sequences on the real axis R. 
Concepts of objective and strong objective infinite sample consistent estimates 
for statistical structures are introduced also in this section. Section 3 presents 
a certain construction of the objective infinite sample consistent estimate of an 
unknown distribution function which generalises the recent results obtained in 
[27]. There is proved an existence of the infinite sample consistent estimate of 
an unknown distribution function F(F € F) for the family of Borel probability 
measures {pp : F £ F}, where F denotes the family of all strictly increasing 
and continuous distribution functions on R and pp denotes an infinite power 
of the Borel probability measure pf on R defined by F. Section 4 presents an 
effective construction of the strong objective infinite sample consistent estimate 
of the ’’useful signal” in a certain linear one-dimensional stochastic model. An 
infinite sample consistent estimate of an unknown probability density is con¬ 
structed for the separated class of positive continuous probability densities and 
a problem about existence of an objective one is stated in Section 5. In Section 
6, by using the notion of a Haar ambivalent set introduced in [1], essentially 
new classes of statistical structures having objective and strong objective esti¬ 
mates of an unknown parameter are introduced in a Polish non-locally-compact 
group admitting an invariant metric and relations between them are studied in 
this section. An example of such a weakly separated statistical structure is con- 
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structed for which a question asking whether there exists a consistent estimate 
of an unknown parameter is not solvable within the theory (ZF) & {DC). These 
results extend recent results obtained in [19]. In addition, we extend the con¬ 
cept of objective and subjective consistent estimates introduced for R N to all 
Polish groups and consider a question asking whether there exists an objective 
consistent estimate of an unknown parameter for any statistical structure in a 
non-locally compact Polish group with an invariant metric when subjective one 
exists. We show that this question is answered positively when there exists at 
least one such a parameter the pre-image of which under this subjective esti¬ 
mate is a prevalent. In Section 7 we consider some examples of objective and 
strong objective consistent estimates in a compact Polish group {0; 1}^. 

2. Auxiliary notions and facts from functional analysis and measure 
theory 

Let V be a complete metric linear space, by which we mean a vector space (real 
or complex) with a complete metric for which the operations of addition and 
scalar multiplication are continuous. When we speak of a measure on V we will 
always mean a nonnegative measure that is defined on the Borel sets of V and 
is not identically zero. We write S + v for the translation of a set S C V by a 
vector v £ V. 

Definition 2.1. ( [7], Definition 1, p. 221) A measure p is said to be transverse 
to a Borel set S C V if the following two conditions hold: 

(i) There exists a compact set U C V for which 0 < p(U) < 1; 

(ii) p{S + v) = 0 for every v £ V. 

Definition 2.2. ([7], Definition 2, p. 222; [1], p. 1579 ) A Borel set S C V is 
called shy if there exists a measure transverse to S. More generally, a subset of 
V is called shy if it is contained in a shy Borel set. The complement of a shy 
set is called a prevalent set. We say that a set is Haar ambivalent if it is neither 
shy nor prevalent. 

Definition 2.3. ([7], p. 226) We say that ’’almost every” element of V satisfies 
some given property, if the subset of V on which this property holds is prevalent. 

Lemma 2.4 ( [7], Fact 3 , p. 223). The union of a countable collection of shy 
sets is shy. 

Lemma 2.5 ( [7], Fact 8, p. 224). If V is infinite dimensional, all compact 
subsets of V are shy. 

Lemma 2.6 ([9], Lemma 2, p. 58). Let p be a Borel probability measure defined 
in complete separable metric space V. Then there exists a countable family of 
compact sets {Fk)kGN in V such that p{V \ U/ceiV-Ffc) = 0. 

Let be a topological vector space of all real valued sequences equipped 
with Tychonoff metric p defined by p{{xk)keN, (yfc)fceiv) = J2k&N \ x k~yk\/‘l k {l+ 
|Xk - Vk\) for {xk)kaN j ( yk)k&N £ ~R N ■ 


M.Kintsurashvili, T.Kiria, G.Pantsulaia/On objective and strong objective consistent estimated 


Lemma 2.7. ( [16], Lemma 15.1.3, p. 202 ) Let J be an arbitrary subset of N. 
We set 


Aj = {(xi)i£jv : Xi < 0 for i £ J & x, > 0 for i £ N \ J}. (2-1) 

Then the family of subsets $ = {Aj : J C N } has the following properties: 

( i ) every element of $ is Haar ambivalent. 

(ii) Aj x n Aj 2 = 0 for all different J\,Ji C TV. 

(■ Hi ) $ is a partition ofH N such that card($>) = 2 N °. 

Remark 2.8. The proof of the Lemma 2.7 employs an argument stated that 
each Borel subset of R lV which for each compact set contains it’s any translate 
is non-shy set. 

Definition 2.9. ([10]) A sequence ( Xk)keN of real numbers from the interval 
(a, b) is said to be equidistributed or uniformly distributed on an interval (a, b) 
if for any subinterval [c, d] of (a, b) we have 

lim n -1 #({z ,x n }C [c,d]) = (6 - a)~ 1 {d - c), (2.2) 

n—¥ oo 

where f[ denotes a counting measure. 

Now let A be a compact Polish space and p. be a probability Borel measure 
on X. Let TZ(X) be a space of all bounded continuous functions defined on X. 

Definition 2.10. A sequence ( Xk)keN of elements of X is said to be /z-equidistri- 
butted or /z-uniformly distributed on the X if for every / £ R-(X) we have 

lim n 

n—foo 

Lemma 2.11. ([10], Lemma 2.1, p. 199) Let f £ 1Z(X). Then, for p N -almost 
every sequences {xk)k£N £ X N , we have 

lim n 

n—¥ oo 

Lemma 2.12. ([10], pp. 199-201) Let S be a set of all p-equidistributed se¬ 
quences on X. Then we have p N (S) = 1. 

Corollary 2.13. ([27], Corollary 2.3, p. fl3) Let i\ be a Lebesgue measure on 
(0,1). Let D be a set of all t\-equidistributed sequences on (0,1). Then we have 
t?{ D ) = 1 . 


= / f d 9- 
, Jx 


(2.4) 


J2f{x k ) = j fdp. 


(2.3) 


Definition 2.14. Let p be a probability Borel measure on R and F be its 
corresponding distribution function. A sequence ( Xk)keN of elements of R is 
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said to be yu-equidistributed or /x-uniformly distributed on R if for every interval 
[a, b] (—00 < a < b < +oo) we have 

lim n _1 #([a, b] n {^i, • • • , x n }) = F(b) - F(a). (2.5) 

n—foo 

Lemma 2.15. ([27], Lemma 2.4, p■ 473) Let (xk)keN be £i~equidistributed 
sequence on (0,1), F be a strictly increasing continuous distribution function on 
R and p be a Borel probability measure on R defined by F. Then ( F~ 1 (xk))keN 
is p-equidistributed on R. 

Corollary 2.16. ([27], Corollary 2-4, p. 473) Let F be a strictly increasing 
continuous distribution function on R andpF be a Borel probability measure on 
R defined by F. Then for a set Dp C R N of all p-equidistributed sequences on 
R we have : 

(i) D F = {(F~ 1 (xk))keN ■ {xk)k&N £ D}; 

(ii) Pp(Dp) = 1. 

Lemma 2.17. Let F\ and F 2 be two different strictly increasing continuous 
distribution functions on R and pi and p 2 be Borel probability measures on R 
defined by F\ and F 2 , respectively. Then there does not exist a sequence of real 
numbers (xfc)fceN which simultaneously ispi-equidistributed andp 2 -equidistributed. 

Proof. Assume the contrary and let (xk)ke n be such a sequence. Since F\ and 
F 2 are different there is a point Xq £ R such that Fi(x 0 ) ^ F 2 (x 0 ). The latter 
relation is not possible under our assumption, because simultaneously 

is pi-equidistributed and p 2 -equidistributed, which implies 

Fi(x 0 ) = lim n^ 1 #((-oo,a;o] D {aq, • • • ,x n }) = F 2 (x 0 ). (2.6) 

n—> oo 

□ 

Theorem 2.18. Let F\ and F 2 be two different strictly increasing continuous 
distribution functions on R and pi and p 2 be Borel probability measures on R 
defined by F\ andF 2 , respectively. Then the measures p]] and pi] are orthogonal. 

Proof. Let Dp 1 and Dp 2 denote pi-equidistributed and p 2 -equidistributed se- 
cjuences on R, respectively. By Lemma 2.17 we know that Dp 1 D Dp 2 = 0. By 
Corollary 2.16 we know that p]{Dpfj = 1 and p 2 (F>p 2 ) = 1. This ends the 
proof of the theorem. □ 

Definition 2.19. Let {p,i : i £ 1} be a family of probability measures defined 
on a measure space (X, M). Let S(X) be defined by 

S{X) = n ig /dom(7q), (2.7) 

where Ji, denotes a usual completion of the measure pi and dom(/I i ) denotes the 
sigma-algebra, of all Tq-measurable subsets of X for each i £ I. We say that the 
family {pi : i £ 1} is strong separable if there exists a partition {Ci : i £ 1} of 
the space X into elements of the u-algebra S(X) such that JlfiCi) = 1 for each 
i £ I. 
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Definition 2.20. Let {fii : i £ 1} be a family of probability measures defined on 
a measure space ( X , M). Let L(I) denotes a minimal a- algebra generated by all 
singletons of I and S(X) be the cr-algebra of subsets of X defined by (2.7). We 
say that a (5(X), L (Immeasurable mapping T : X —> I is a consistent(or well- 
founded) estimate of an unknown parameter i (i £ I) for the family {fii : i £ 1} 
if the following condition 

(Vi)(ieI^ Ml (T- 1 ({i}) = 1)) (2.8) 

holds true. 

Lemma 2.21. ([27], Lemma 2.5, p. f7f) Let {fit : i £ 1} be a family of proba¬ 
bility measures defined on a measure space ( X , M). The following sentences are 
equivalent: 

(i) The family of probability measures {fii : i £ 1} is strong separable; 

(ii) There exists a consistent estimate of an unknown parameter i (i £ I) for 
the family {fii : i £ I}. 

Now let X \, X' 2 , ■ ■ ■ be an infinite sampling of independent, equally dis¬ 
tributed real-valued random variables with unknown distribution function F. 
Assume that we know only that F belongs to the family of distribution func¬ 
tions {Fg : 8 £ 0}, where 0 is a non-empty set. Using these infinite sampling we 
want to estimate an unknown distribution function F. Let fig denotes a Borcl 
probability measure on the real axis R generated by Fg for 0 £ 0. We denote 
by /ig an infinite power of the measure fig, i.e., fi^ = fig x fig x • • • . 

The triplet (R N , B(R N ), fig r )ee@ is called a statistical structure described 
our infinite experiment. 

Definition 2.22. A Borel measurable function T n : R” —> R (n £ N) is called 
a consistent estimator of a parameter 9 (in the sense of everywhere convergence) 
for the family {fig )# 6 © if the following condition 

Tg({{xk)keN ■ (it)teAf £ R w & lim T n {x\, ■ ■ ■ , x n ) = 8 }) = 1 (2.9) 

n—too 

holds true for each 8 £ 0. 

Definition 2.23. A Borel measurable function T n : R” —> R (n £ N) is called a 
consistent estimator of a parameter 9 (in the sense of convergence in probability) 
for the family [fig )eg© if for every e > 0 and 9 £ 0 the following condition 

lim fig {{{xk)keN ■ {xk)k&N € R iV & \T n { Xl ,--- ,x n )-8\ > e}) = 0 (2.10) 

n—> oo 

holds true. 

Definition 2.24. A Borel measurable function T n : R” —> R (n £ N) is called a 
consistent estimator of a parameter 8 (in the sense of convergence in distribution 
) for the family (fig[)geo if for every continuous bounded real valued function / 
on R the following condition 

lim [ f(T n (xi,--- ,x n ))dfig((x k )keN) = f(9) 

n—>■ oo JyiN 


( 2 . 11 ) 
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holds. 

Remark 2.25. Following [23] (see, Theorem 2, p. 272), for the family (p^)g e R 
we have: 

(a) an existence of a consistent estimator of a parameter 9 in the sense of 
everywhere convergence implies an existence of a consistent estimator of a pa¬ 
rameter 9 in the sense of convergence in probability; 

(b) an existence of a consistent estimator of a parameter 9 in the sense of 
convergence in probability implies an existence of a consistent estimator of a 
parameter 9 in the sense of convergence in distribution. 

Now let L(0) be a minimal cr-algebra of subsets generated by all singletons 
of the set 0. 

Definition 2.26. A (B(R N ), L(0))-measurable function T : R/ v —> 0 is called 
a infinite sample consistent estimate (or estimator) of a parameter 9 for the 
family (p,ff)g G Q if the condition 

He ({{xk)keN '■ (xk)keN € R w & T((xfc)fc S jv) = 9}) = 1 (2-12) 

holds true for each 9 £ 0. 

Definition 2.27. An infinite sample consistent estimate T : R w —> 0 of a 
parameter 9 for the family is called objective if T~ 1 (9) is a Haar 

ambivalent set for each 9 £ 0. Otherwise, T is called subjective. 

Definition 2.28. An objective infinite sample consistent estimate T : R ¥ —> 0 
of a parameter 9 for the family (^)g G Q is called strong if each 9i, 9i € 0 there 
exists an isometric (with respect to Tychonoff metric) transformation Are lt $ 2 ) 
of R ¥ such that A^g ly g 2 ^(T~ 1 (9i))AT~ 1 (92) is shy. 

Definition 2.29. Following [26], the family is called strictly separated 

if there exists a family (Zg)g e Q of Borel subsets of H N such that 

(i) ( Zg ) = 1 for 9 € 0; 

(ii) Zg 1 fi Zg 2 = 0 for all different parameters 9\ and 9i from 0. 

(hi) U g^eZg = R lV . 

Remark 2.30. Notice that an existence of an infinite sample consistent estima¬ 
tor of a parameter 9 for the family implies that the family (n^BeO is 

strictly separated. Indeed, if we set Zg = {(xk)k&N ■ {x k ) k£N £ R N & T((x k ) keN ) 
0} for 9 € 0, then all conditions participated in the Definition 2.29 will be sat¬ 
isfied. 

3. An objective infinite sample consistent estimate of an unknown 
distribution function 

Theorem 3.1. Let J- be a family of distribution functions on R satisfying the 
following properties: 

(i) each element of T is strictly increasing and continuous; 
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(ii) there exists a point x * such that Fi(x *) ^ F^x*) for each different 


Fi, f 2 ef. 

Setting 0 = {0 = F(x „) : F G F} and Fg = F for 6 = F(x *), we get the 
following parametrization F = {T# : 0 6 0}. We denote by pg a Borel probability 
measure in R defined by Fg for 9 G 0. Then a function T n : R" —> R, defined 
by 


T„(x i, • 


: ‘Xn) 


#({xi, • • • , x n } n (-oo; x*]) 


(3-1) 


n 

for (xi, • • • , x n ) G R n (n G N), is a consistent estimator of a parameter 6 for 
the family (pgf)ge@ in the sense of almost everywhere convergence. 


Proof. It is clear that T n is Borel measurable function for n G N. For 9 G R, 
we set 


Ag = {(xk)k£N '■ (a ; fe)fceiv is Pe — uniformly distributed on R}. (3.2) 

Following Corollary 2.16, we have pff(Ag) = 1 for 9 G 0. 

For 9 G 0, we get 


Pg ({(x k )keN eR N : \im T n (xi,-■■ ,x n ) = 9}) = pg ({(x k ) keN GR N : 

n—»■ oo 

lim n _1 #({xi, • • - ,x n } 0 (-oo;x*]) = F e (x*)}) > Pg (Ag) = 1. (3.3) 

n—> oo 

□ 

The following corollaries are simple consequences of Theorem 3.1 and Remark 
2.25. 

Corollary 3.2. An estimator T n defined by (3.1) is a consistent estimator of a 
parameter 9 for the family (pgf)ee@ in the sense of convergence in probability. 

Corollary 3.3. An estimator T n defined by (3.1) is a consistent estimator of a 
parameter 9 for the family (p-^)g^Q in the sense of convergence in distribution. 

Theorem 3.4. Let F = {Fg : 9 G 0} and (p^)gee come from Theorem 3.1. Let 
fix 9o G 0 and define an estimate Tg l J : R^ — > 0 as follows: Tjjj((x k )keN) = 
limT n ((a;fc)fcgiv) if \im.T n ((x k )keN ) G 0 \ {6»o} and T^\(x k ) keN ) = 9 q 1 other¬ 
wise, where limT ra = inf n sup m>ra T m and 

T n ((x k ) k eN ) = n _1 #({xi, • • • , x n } n (-oo; x*])) (3.4) 

for (x k ) k £N S R v . Then Tgj is an objective infinite sample consistent estima¬ 
tor of a parameter 9 for the family (p^)g^Q- 

Proof. Following [23] (see, p. 189), the function limT n is Borel measurable which 
implies that the function limT ra is (B(R N ), L(0))-measurable. Following Corol¬ 
lary 2.16, we have pg (Ag) = 1 for 9 G 0, where Ag is defined by (3.2). Hence 
we get 

Pe'({(x k ) keN GR N : T^(x k ) keN = 9})> 
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He ((Ofc)fceiv G R V : lim T n (x k )keN = 9}) > 

He {{(xk)keiv G R ¥ : lim T n (x k ) k€N = 

\hnT n (x k )keN = -F e (x*)}) > He i A e) = 1 (3.5) 

for 9 £ 0. Thus we have proved that the estimator T ,1 ) 6 , o is an infinite sample 
consistent estimator of a parameter 0 for the family (pL^)g^Q. 

Now let us show that TWg 0 is an objective infinite sample consistent esti¬ 
mator of a parameter 9 for the family (H^)ee@- 

Let us show that B(9) := ( 9 ) is a Haar ambivalent set for each 

8 £ 0 . 

Let (xfe)fcgjv be ^-uniformly distributed sequence on R. Then we get 

lim n _1 #({xi, • • • , x n } n (-oo; x»]) = 9. (3.6) 

n—too 

Let consider a set 

C(9) = {{yk)k&N -yk< x k if x k < x* & y k > x k if x k > x*}. (3.7) 

Setting J = {fc : Xfc < x*}, we claim that C(9) — (x k ) k ^N = Aj, where Aj 
comes from Lemma 2.7. Since any translate of Haar ambivalent set is again 
Haar ambivalent set, we claim that C(9) is Haar ambivalent set. A set B(9) 
which contains the Haar ambivalent set C(9) is non-shy. Since 9 £ 0 was taken 
arbitrary we deduce that each Bg is Haar ambivalent set. The latter relation 
means that the estimator T (1 ^ 0 is an objective infinite sample consistent esti¬ 
mator of a parameter 9 for the family (p^)g^Q. □ 

Theorem 3.5. Let F — {Fg : 9 £ 0} and come from Theorem 

3.1. Let fix 9 q £ 0 and define an estimate T ,2 lg 0 : R w — > 0 as follows: 
T ,2) 0 O ((xfc)fcgjv) = hmT^X(x fc ) fceJV ) ifYrmTjfx^kzN) G 0 \{ 0 O } andT [2 '>g 0 ((x k ) k& N) 
9q otherwise, where lim Th = sup„ inf m > n T m and 

T n ((x k ) keN ) = n _1 #({xi, • • • , x„} (~l (-oo; x*]) (3.8) 

for (xfc)fc g Ar G R w . Then T^ 2 )^ is an objective infinite sample consistent esti¬ 
mator of a parameter 9 for the family (Hg r )ee@- 

Proof. Following [23] (see, p. 189), the function lim Th is Borel measurable which 
implies that the function limT„ is (B(TL n ), L(0))-measurable. Following Corol¬ 
lary 2.16, we have Hg {Ag) = 1 for 9 £ 0, where Ag is defined by (3.2). Hence 
we get 

Hg 1 ({{ x k)kGN G R W : T 1 - 2 ' 1 g 0 (x k )keN = 9}) > 

He {{(x k ) k £N G R. W : lim T n (x k )keN = 0}) > 

Hg ({(xk)k^N G R . lim T n (x k ) k ^j^ — 
limT n (x fc ) fce jv = Fg(x *)}) > He (Ag) = 1 


(3.9) 
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for 9 G 0. 

Thus we have proved that the estimator T (2 ^ 0 is an infinite sample consistent 
estimators of a parameter 9 for the family {n$)ee&- 

Now let us show that T*^ 2 ^ is an objective infinite sample consistent esti¬ 
mator of a parameter 9 for the family (/^)seO- 

Let us show that B(9) = (T 12 ^) 1 {9 ) is Haar ambivalent set for each 9 G 0. 
Let (xk)keN be /ig-uniformly distributed sequence. Then we get 

lim n _1 #({xi, • • • , x n } D (—oo; x*]) = 6. (3.10) 

n—too 


Let consider a set 

C(0) = {{Vk)k£N ■ (? /k)k£N G & Uk < x k if x k < x* & y k > x k if x k > £*}• 

(3.11) 

Setting J = {k : x k < x*}, we deduce that C(9) — ( x k )keN = Aj , where Aj 
comes from Lemma 2.7. Since any translate of Haar ambivalent set is again Haar 
ambivalent set, we claim that C(9) is Haar ambivalent set. A set B(9) which 
contains the Haar ambivalent set C(9) is non-shy. Since 9 G 0 was taken arbi¬ 
trary we deduce that each Bg is Haar ambivalent set. The latter relation means 
that the estimator T^ 2 ^ 0 is an objective infinite sample consistent estimator of 
a parameter 9 for the family □ 

Remark 3.6. It can be shown that Theorems 3.4 and 3.5 extend the recent 
result obtained in [20] (see Theorem 3.1). Indeed, let consider the linear one¬ 
dimensional stochastic system 

(Cfe)feeiv = ( 0k)keN + (Afc)fe 6 Ar, (3-12) 

where ( 9 k ) k eN £ R V is a sequence of useful signals, (A k )keN is sequence of 
independent identically distributed random variables (the so-called generalized 
“white noise” ) defined on some probability space (f^A, P) and {£k)keN is a 
sequence of transformed signals. Let /r be a Borel probability measure on R 
defined by a random variable Ai. Then the A 7 -power of the measure [i denoted 
by ft N coincides with the Borel probability measure on R w defined by the 
generalized “white noise”, i.e., 

(VA)(A G B(R n ) -»■ fi N (X) = P({w : w G SI & (A fc ( w )) fceJV G A})), (3.13) 

where B(H N ) is the Borel cr-algebra of subsets of R w . 

Following [26], a general decision in the information transmission theory is 
that the Borel probability measure A, defined by the sequence of transformed 
signals (£k)k&N coincides with (ld N ) 6g for some 9q G 0 provided that 

(30 o )(0o £04 (VA)(A G B(R n ) X(X) = (/x^JA))), 

where (/i w ) 6g (X) = p N (X - 9 0 ) for A G ^(R*). 


(3.14) 
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In [27] has been considered a particular case of the above model (3.12) for 
which 

(Ok)kGN £ {{9,9, ■■■) :9 £ R}. (3.15) 

For 0 £ R, a measure /iff defined by 

He = He x /j, e x ■■■ , (3.16) 

where He is a 0-shift of fi (i.e., He{X) = h{X — 0) for X £ £>(R)), is called the 
IV-power of the 0-shift of fi on R. 

Let denote by Fg a distribution function defined by fig for 0 £ 0. Notice that 
the family T = {Fg : 0 £ 0} satisfies all conditions participated in Theorems 3.1. 
Indeed, under a;* we can take the zero of the real axis. Then following Theorems 
3.4 and 3.5, estimators Tgj and Tgj are objective infinite sample consistent 
estimators of a useful signal 0 in the linear one-dimensional stochastic system 
(3.12). Notice that these estimators exactly coincide with estimators constructed 
in [20] (see Theorem 3.1). 

Theorem 3.7. Let F be a family of all strictly increasing and continuous dis¬ 
tribution functions in R and pf be a Borel probability measure on R defined by 
F for each F £ F. Then the family of Borel probability measures {pp : F £ F){ 
is strong separable. 

Proof. We denote by Dp the set of all p^-equidistributed sequences on R for 
each F £ F. By Lemma 2.17 we know that Dp 1 fl Dp 2 = 0 for each different 
Fi : F 2 £ F. By Corollary 2.16 we know that pp(Dp) = 1 for each F £ F. Let 
fix Fq £ F and define a family (C'f)fg.f of subsets of R w as follows: Cf = Dp 
for F £ F\{F 0 } and Cf 0 = R^VU fgf\{f 0 }Df. Notice that since Dp is a Borel 
subset of R w for each F £ F we claim that Cf £ S(R N ) for each F £ F\ {To}, 
where S(R N ) comes from Definition 2.19. Since Pf(R n \UfgfDf) = 0 for each 
F £ F, we deduce that H n \UfffDf £ np e pdom(pp) = S(R N ). Since S(R N ) 
is the CT-algebra, we claim that Cp 0 £ S(R N ), because pp(R N \ U F^pDp) = 0 
for each F £ ^(equivalently, R w \ U F^pDp £ S(R N )), and 

Cfo = \ = (FL V \ Ufg^^f) U D Fq . (3.17) 

This ends the proof of the theorem. □ 

Remark 3.8. By virtue the results of Lemma 2.21 and Theorem 3.7 we get that 
there exists a consistent estimate of an unknown distribution function F (F £ F) 
for the family of Borel probability measures {pp : F £ F{ 1 where F comes from 
Theorem 3.7. This estimate T : R w —> F is defined by : T((xk)kpN) = F 
if (xk)keN £ Cp , where the family {Cf)f^f of subsets of R" ¥ also comes 
from Theorem 3.7. Notice that this result extends the main result established 
in [27] (see Lemma 2.6, p. 476). 

At end of this section we state the following 
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Problem 3.1. Let F be a family of all strictly increasing and continuous dis¬ 
tribution functions on R and pf be a Borel probability measure in R defined by 
F for each F £ F. Does there exist an objective infinite sample consistent esti¬ 
mate of an unknown distribution function F for the family of Borel probability 
measures {pp : F £ F)) ? 

4. An effective construction of the strong objective infinite sample 
consistent estimate of a useful signal in the linear 
one-dimensional stochastic model 

In [18], the examples of objective and strong objective infinite sample consis¬ 
tent estimates([18], T*(p. 63), T°(p. 67)) of a useful signal in the linear one¬ 
dimensional stochastic model were constructed by using the axiom of choice 
and a certain partition of the non-locally compact abelian Polish group R N 
constructed in [17]. 

In this section, in the same model we present an effective example of the 
strong objective infinite sample consistent estimate of a useful signal constructed 
in [19]. 

For each real number a £ R, we denote by {a} its fractal part in the decimal 
system. 

Theorem 4.1. Let consider the linear one-dimensional stochastic model (3.12), 
for which ’’white noise” has a infinite absolute moment of the first order and 
its moment of the first order is equal to zero. Suppose that the Borel proba¬ 
bility measure A, defined by the sequence of transformed signals (£fc)fceiv co¬ 
incides with (p^ 0 ) for some 9 0 £ [0,1]. Let T : R N —> [0,1] be defined by: 

T((x k ) kGN ) = {lim^oo if lim^oo ± 1, T((x k )keN) = 1 */ 

Hindoo — = 1, and T((x k ) kGN ) = J2k&N x< -°’ + ^ k ){xk \ otherwise, where 
X(0,+oo)(‘) denotes an indicator function of the set (0,+oo) defined on the real 
axis R. Then T is a strong objective infinite sample consistent estimate of the 
parameter 9 for the statistical structure (R N , B(R N ), p.^ )ee© describing the lin¬ 
ear one-dimensional stochastic system (3.12). 

Proof. Step 1. We have to show that T is an infinite sample consistent esti¬ 
mate of the parameter 9 for the statistical structure (R N , B(R N ), and 

T -1 (0) is a Haar ambivalent set for each 9 = ffr £ 0, where fit is 

representation of the number 6 in the binary system. 

Indeed, we have 


(V0)(0 £ (0,1) T~\9) = (B hw \ S) U U zeZ S e+z ), (4.1) 

where H(9) = {k : k £ N & 9 k = 1 }, B H (#) = 9 — A H (q), A h ^ comes from 
Lemma 2.7, 


S = {{x k ) k eN £ R ¥ : exists a finite limit 


lim 

n—»oo 


E n 

k= 1 Xk 


} 


(4.2) 


n 
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and 

S 0+z = {{xk)keN G : lim ^=i Xk = e + zj (4.3) 

n—>oo Tt 

for each 9 G 0 and z G Z. Notice that the set S like U z€ zSg+ z is Borel shy 
set (see [18], Lemma 4.14, p. 60). Taking into account this fact, the results of 
Lemmas 2.4 and 2.7, invariance of Haar ambivalent sets under translations and 
symmetric transformation and the simple statement that difference of non shy 
and shy sets is non shy, we deduce that T _1 (0) is a Borel measurable Haar 
ambivalent sets for each 9 £ 0. 

Notice that 


T~\l) = (B h{1) \S)US 1 = (B n \S)US 1 (4.4) 

and 


T~\ 0) = (B h10 ) \ S) U U, 6Z \ {1} S 0 +* = (£? 0 \ S) U U ze z\{i}So+z, (4.5) 

which also are Borel measurable Haar ambivalent sets. 

Now it is not hard to show that T is (B(R N ), L(0))- measurable because 
the class B(R N ) is closed under countable family of set-theoretical operations 
and each element of L(0) is countable or co-countable in the interval 0 = [0,1]. 
Since Sg C T~ l {9) for 9 e 0, we deduce that n g(T~ l {9 )) = 1. The later relation 
means that T is an infinite sample consistent estimate of a parameter 9. 

Step 2. Let us show that for each different 6i, 02 G [0,1] there exists an iso¬ 
metric (with respect to Tychonoff metric) transformation A^g 1 g 2 -) such that 

A { g 1}B2) (T-\9 1 ))AT- 1 (9 2 ) (4.6) 


is shy. 

We define A^^ as follows: for (x k )k&N G R N we put ^(e 1 ,e 2 )((^fe)fce jv) = 
(yfe)fceiv, where y k = -x k if k G H(9i)AH( 9 2 ){:= (H(9i) \ H{9 2 )) U (i/(0 2 ) \ 
H(9i)) and y k = x k otherwise. It is obvious that A/g lt g 2 ) is isometric (with 
respect to Tychonoff metric) transformation of the R N . 

Notice that 


A { g 1 ,g 2 )(T-\9 1 ))AT-\9 2 ) C U k&N {0} k x R N \™ y 5. (4.7) 

Since both sets Ufe e iv{0}fc x R N \W and S are shy, by Lemmas 2.4 and Definition 
2.2 we claim that the set 


A i g lt g 2) (T-\9 1 ))AT-\9 2 ) 


is also shy. 

This ends the proof of the theorem. 


(4.8) 

□ 
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5. On infinite sample consistent estimates of an unknown 
probability density function 

Let Xi,X 2 , • • • be independent identically distributed real-valued random vari¬ 
ables having a common probability density function /. After a so-called kernel 
class of estimates f n of / based on X\, X 2 , ■ ■ ■ , X n was introduced by Rosen¬ 
blatt [21], various convergence properties of these estimates have been studied. 
The stronger result in this direction was due to Nadaraya [13] who proved that 
if / is uniformly continuous then for a large class of kernels the estimates f n 
converges uniformly on the real line to / with probability one. In [22], has been 
shown that the above assumptions on / are necessary for this type of conver¬ 
gence. That is, if /„ converges uniformly to a function g with probability one, 
then g must be uniformly continuous and the distribution F from which we are 
sampling must be absolutely continuous with F ( x ) = g(x) everywhere. When 
in addition to the mentioned above, it is assumed that / and its first r + 1 
derivatives are bounded, it is possible to show that how to construct estimates 
f n such that fn' 1 converges uniformly to as a given rate with probability 
one for s = 0, • • • , r. Let f n (x ) be a kernel estimate based on X\ 1 X 2 , ■ ■ ■ , X n 
from F as given in [21], that is 

TL 

f n {x) = (na rl ) _i y'fc(—-) (5.1) 

where (a„) ne jv is a sequence of positive numbers converging to zero and k is 
a probability density function such that f_ oo|a:|fc(x)dx is finite and k^ is 
continuous function of bounded variation for s = 0, • ■ • , r. The density function 
of the standard normal, for example, satisfies all these conditions. 

In the sequel we need the following wonderful statement. 

Lemma 5.1. ( [22], Theorem 3.11, p. 1194) A necessary and sufficient condi¬ 
tion for 

lim sup | f n (x) - g(x)\ = 0 (5.2) 

n-K>o 

with probability one for a function g is that g be the uniformly continuous deriva¬ 
tive of F. 

Let X\,X 2 ,-- ■ be independent and identically distributed real-valued ran¬ 
dom variables with an unknown probability density function /. Assume that we 
know that / belongs to the class of probability density function SC each element 
of which is uniformly continuous. 

Let denote by £°°(R) an infinite-dimensional non-separable Banach space of 
all bounded real-valued functions on R equipped with norm || • ||oo defined by 

\\h\\oo = sup \h{x)\ (5.3) 

xGR 

for all h G £°°(R). We say that (£°°(R)) lim n ^.oo h n = ho if lim^oo | \h n — 
h 0 11 oo 0* 
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Theorem 5.2. Let (j> denotes a normal density function. We set 0 = SC. Let 
/ig be a Borel probability measure on R with probability density function 9 G 0. 
Let fix 0 Q G 0. For each ( Xi) iGN we set: T S c({xi)ieN) = lim^oo fn 

if this limit exists and is in 0 \ {$o}> and Tsc{{xi)i£N) = 9 q, otherwise. Then 
Tsc is a consistent infinite-sample estimate of an unknown parameter 6 for the 
family {pg)g e e- 

Proof. By Lemma 5.1, for each 9 G 0 we have 

Pei {{{xi)ieN G R w : Tsc({xi)ieN) = 8}) > 

e rW : (^°°( R )) lim fn = 0}) = 
n—> oo 

Pg ({( x i)ieN G rJV : lim ||/„ - 0||oo = 0}) = 1. 

n—> oo 

This ends the proof of theorem. 

□ 

Concerning with Theorem 5.2 we state the following problems. 

Problem 5.1. LetTsc comes from the Theorem 5.2. IsTsc an objective infinite 
sample consistent estimate of the parameter 6 for the family (/UgOtfe© ? 

Problem 5.2. Let the statistical structure {(R ff , B(R N ), pff) : 9 G 0} comes 
from the Theorem 5.2. Does there exist an objective (or strong objective) infinite 
sample consistent estimate of the parameter 8 for the family (p^)ee0 ? 

Let Xi, X 2 , ■ ■ ■ be independent and identically distributed real-valued ran¬ 
dom variables with positive continuous probability density function /. Assume 
that we know that / belongs to the separated class A of positive continuous 
probability densities provided that there is a point X* such that gi(x*) ^ < 72 ( 2 ;*) 
for each gi,g 2 G A. Suppose that we have an infinite sample (xk)keN and we 
want to estimate an unknown probability density function. Setting 0 = {9 = 
g(x *) : g G .4}, we can parameterise the family A as follows:^! = {fg : 9 G 0}, 
where fg is such a unique element / from the family A for which f(x *) = 9. Let 
fig be a Borel probability measure defined by the probability density function 
fg for each 9 G 0. It is obvious that {(il N p^) : 9 G 0} will be the 
statistical structure described our experiment. 

Theorem 5.3. Let (h m ) m6 n be a sequence of a strictly decreasing sequence of 
positive numbers tending to zero. Let fix 9 q G 0. For each ( Xk)keN G R^ we 
put 

rji /! \ \ !• V I X n } D [x* — h m , X» + h m ]) ! ^ 

T{(xk)kGN) = hm lim -—- (5.4) 

m —>00 n —>00 Znllm 

if this repeated limit exists and belongs to the set 0\{0} ; and T((xk)kGN) = 9 q, 
otherwise. Then T is an infinite sample consistent estimate of the parameter 9 
for the family (pg)g^e- 
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Proof. For each 0 G 0, we put 

Ag = {(Xk)keN '■ (Xk)keN £ R w & (xk )keN is [ig — equidistributed}. 

By Corollary 2.16 we know that [iff (Ag) = 1 for each 9 £ 0. 

For each 0 £ 0, we have 

f iff(T- 1 ( 0 )) = t iff({(x k )k eN e R N : T((x k ) k&N ) = 0 }) > 


[iff ({(xk)keN £ Ag : T((xk)kGN) = 0}) = 

n 111 \ * i . Fg (x* T h m ) Fg (x* h m ) 

[ Ig ({( Xk)keN £ Ag : hm -—- 

m—too Z/l m 


= 9 }) = 


rx^-^hfn p / \ 7 

„ / , te\X)ax 

({(^fe)feeJV £ : lim ——^-= 6>}) = 

m—>■ 00 z/l m 

({(xfe)fegAr £ ^0 : /e(a;*) = 6»}) = ^(Ag) = 1 


(5.5) 


(5.6) 

□ 


Concerning with Theorem 5.3 we state the following 

Problem 5.3. Let T comes from the Theorem 5.3. Is T an objective infinite 
sample consistent estimate of the parameter 9 for the family (fiff)g^Q? 

Problem 5.4. Let the statistical structure {(R w , B(R JV ), [iff) : 9 £ 0} comes 
from the Theorem 5.3. Does there exist an objective (or strong objective) infinite 
sample consistent estimate of the parameter 9 for the family (fiff)g^Q ? 

Example 5.4. Let X\, A' 2 , • • • be independent normally distributed real-valued 
random variables with parameters (a, a) where a is a mean and a is a standard 
deviation. Suppose that we know the mean a and want to estimate an unknown 
standard deviation a by an infinite sample (xk)kGN- For each a > 0, let denote 
by [i a the Gaussian probability measure on R with parameters (a, a) (here a £ R 
is fixed). Let (h m ) m& N be a sequence of a strictly decreasing sequence of positive 
numbers tending to zero. 

By virtue of Theorem 5.f we know that for each a > 0 the following condition 

[iff ({(Zfc)fcGJV £ R^ & 


lim lim 

m —>00 n —>00 


ff(\_x\i , x n f n [n a T F m ]) 1 


2 nh r 


\[2lTC 


-}) = 1 


holds true. 

Let fix do > 0. For ( Xk)keN £ R w we put 
Ti((x k )kGN) = lim lim 


2 nh„ 


\/27t#({:ei, • • • ,x n }n [a-h m ,a +h m ]) 


(5.7) 


(5.8) 


if this limit exists and belongs to the set (0, + 00 ) \ {(Jo}, and Ti((xk)k&N) = 00 , 
otherwise. Then for each a > 0 we get 


hff ({( x k)k&N ■ ( x k)k£N £ R^ & Pi ((^fe)fcGiv) = O'}) = 1 


(5.9) 
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which means that T\ is an infinite sample consistent estimate of the standard 
deviation a for the family {fj.^) a >o- 

Theorem 5.5. Let Xi, X 2 , ■ ■ ■ be independent normally distributed real-valued 
random variables with parameters (a, a), where a is a mean and a is a stan¬ 
dard deviation. Suppose that we know the mean a. Let (ctri)neiv be a sequence 
of positive numbers converging to zero and (f> be a standard Gaussian density 
function in R. We denote by a Borel Gaussian probability measure in R 
with parameters (a, a) for each a € £ = (0,oo). Let fix ao G £. Let define 

an estimate : R w —> £ as follows : Ta]\{xk)keN) = li mTn^^x^keN) 

if limTi 1) ((a : k )keN) G £h\ {cr 0 } and T$((x k )keN) = cr 0 , otherwise, where 

limT^ 1 ^ := inf„ sup m > n and 


Tn\{x k )keN) = T^\xi,-- - ,x n ) = 


V^K ) -1 E"=i ^>(^tr) 


(5.10) 


for ( Xk)k£N G R w • Then is an infinite sample consistent estimator of a 
parameter a for the family {Ha)aei:- 

Proof. Following [23] (see, p. 189), the function limT^ 1 ’* is Borel measurable 

which implies that the function limT'i 1 '* is (S(R W ), L(£))-measurable. 

For each a £ £ we put 

n 

Aa = {(x k )k£N G R v : limn^oo^anY 1 'V' <f>(— —-) = (5.11) 


2=1 


Since uniformly convergence implies pointwise convergence, by Lemma 5.1 we 
deduce that pff {A a ) = 1 for a £ £ which implies 

Ha ({(Xfe)fcGJV G R W : Tgj (x k )k£N = o }) > 

Ha ({( x k)keN GR" : liirf^a*) keN = cr}) > 

Ha {{( x k)keN G W N : limTn \x k )k£N = lim Tn\x k )ke N = <?}) = 

Ha({(x k )keN G R N : lim T^\{x k )keN) = cr}) = 

n—> 00 


Pa {{(%k)keN G R 


N 


lim 


™ ^nan )- 1 EIU 


- = cr}) = 

—a \ J ' 


_ -1 

lim {nan)- 1 ^ (/>{——-) = ~7^=-}) = 

n ^°° r-f a n V27rcr 

2=1 


Ha {{{ x k)keN G R W 
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n 

A £({{xk)keN £ n N ■ lim (na„) _1 V 0(—--) = U(a)}) = {A a ) = 1. 

n—Kco z —' a n 

(5.12) 

□ 

The following theorem gives a construction of the objective infinite sample 
consistent estimate of an unknown parameter a in the same model. 

Theorem 5.6. Let X±,X 2 , • • • be independent normally distributed real-valued 
random variables with parameters (a, a), where a is a mean and a is a standard 
deviation. Suppose that we know the mean a is non-zero. Let $ be a standard 
Gaussian distribution function in R. We denote by fio a Borel Gaussian prob¬ 
ability measure in R with parameters (a, a) for each o £ E = (0, oo). Let fix 
ctq £ E. Let define an estimate : R^ —> E as follows: ((x k )keN) = 

MmT^ ((x k )keN) i[YimT^\(x k ) keN ) £S \ {er 0 } and T$((x k ) k€ N ) = a 0 , oth¬ 
erwise, where limT,l“^ := inf„ sup m>n and 


Ti 2 \(x k ) keN ) =T( 2 \x lr •• ,x n ) 


a 


-1 ,3 w }n(-oo,0])> 


d> 


(5.13) 


for (x k )keN £ R N . Then is an objective infinite sample consistent estima¬ 
tor of a parameter a for the family (p.^)ae's- 

Proof. Following [23] (see, p. 189), the function limT^ 2 ’* is Borel measurable 

which implies that the function limT’i 2 '* is (B(R, N ), L(E))-measurable. 

For each a £ E we put 

^■(t — {(^'fc)fceA^ £ R N : (x k )keN is Her — equidistributed in R}. (5-14) 

By Corollary 2.16 we know that Ho (A a ) = 1 for a £ E which implies 

Ha ({(^fe)feeiv G : limT 'n\x k )keN = <r}) > 

Ha{{{ x k)keN G R W : liinTl 2) (xfe) fcG Ar = limT,i 2) (a;fc)fc 6 jv = cr}) = 
^({(^Jieiv £ R N : lim Tn\(x k )k£N) = cr}) = 


Ha ({(Zfc)fceiV G 


lim 

n—¥ oo 


a 

.T -.-1 / (#(hi,- ,x„}n(-oo,op) \ 
k n > 


cr}) = 


Mcr ^ 


N 


lim $ 

n—>oo 


—1/-,Zn} fl (-00,0]) 


) = --}) = 
a 


n 








M.Kintsurashvili, T.Kiria, G.Pantsulaia/On objective and strong objective consistent estimate 


Ha ({( X k)keN & R-‘ ¥ 


lim 

n—> oo 


,x n } n (~oo,Q]) 

n 


*<-?>»= 


Ha {{{ X k)keN G R jV 


lim 

n—>oo 


(#({^1; • • ' , x n} H (~OO,0]) 
n 


= *(a,a)(0)})> 


Hai^a) = I- 


(5.15) 


- ( 2 ) 

The latter relation means that limTJi ’ is a infinite-sample consistent estimate 
of a parameter a for the family of measures (p.^) a >o- 
- ( 2 ) 

Let show that limTn is objective. 

We have to show that for each a > 0 the set (limT^ 2 "*) -1 ^) is a Haar am¬ 
bivalent set. 

Let (xfe)fcgAr be ^ CT -equidistributed sequence. Then we get 


which means 


lim 

n—> oo 


(#({£!,••• ,X»} n (-00,0]) 

n 


$(a, CT )(0) 


T al \{xk)k&N) = \iuiT^ 2 \(x k ) k&N ) = a. 


Setting J a = {i : Xi < 0}, it is not hard to show that a set 


(5.16) 

(5.17) 


Bj a = {(yi)i<=N : yi< Xi for i e J kyi > Xi for i e N\J} (5.18) 


is a Haar ambivalent set. 

It is clear also that for each (yi)i^N £ Bj a we have 

T al\(yk)keN) = lim T^ 2) ((y k ) keN ) = a , 

which implies that Bj a C (limTn 2 '*) _ 1 (cr). 

Since {(limTn 2 ) _1 (cr) : a > 0} is a partition of the R v and each of them 

contains a Haar ambivalent set Bj a we deduce that (limTn 2 '* ) _1 (<r) is a Haar 
ambivalent set for each a > 0. 

This ends the proof of the theorem. 

□ 

Theorem 5.7. Let Xi^X?, ■ ■ ■ be independent normally distributed real-valued 
random variables with parameters (a, a) where a is a mean and o is a stan¬ 
dard deviation. Suppose that both parameters are unknown. Let $ be a stan¬ 
dard Gaussian distribution function in R. We denote by n a a Borel Gaus¬ 
sian probability measure in R with parameters (a, a) for each o e S = (0,oo) 
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and a G R. Let fix <to G E. Let define an estimate Y as fol- 

lows: T$((xk)keN) = limTn 3 \{xk)k£N) if limTj 3 \(x k )keN) G £ \ {(Jo} and 
Ta 3 \(xk)keN ) = cr 0 , otherwise, where MmT^ := inf„ sup m > n T^ 3) and 


Ti 3 ) ((x k ) keN ) = T&(x 1 ,--- ,x n ) 


E n 

_i=i ^_ 

r ^-1 ,Zn}n(-OO,0]) ^ 


(5.19) 


for ( Xk)keN G R w . Then Ti 3 '* is an infinite sample consistent estimator of a 
parameter a for the family (Pa)oe's- 

Proof. Following [23] (see, p. 189), the function limT^ 3 ' is Borel measurable 

which implies that the function limT,, 3 '* is (S(R W ), L(E))-measurable. 

For each a 6 E we put 


A a = {(xk)kGN G R W : ( Xk)keN is Po — equidistributed in R} (5.20) 

and 

sr^n 

B a = {{x k )k£N G R n : lim ^ fc=1 Xk = a}. (5.21) 

n—> oo 77 , 

On the one hand, by By Corollary 2.16 we know that p^f(A a ) = 1 for a G E. 
On the other hand , by Strong Law of Large Numbers we know that p^ (Bo) — 1 
for a G £. These relations imply that 


Po (At O Bo) = 1 


(5.22) 


for a G S. 

Take into account (5.22), we get 

Po ({( x k )kGN G R N : limT 7 [ 3) (x k )k£N = cr}) > 

Po ({(xk)keN G R N : limTn 3 \xk)k£N = hmT^ 3) (x k )k£N = 
Po ({(xk)keN G R‘ ¥ : lim ((x k )keN) = c}) = 


cr}) = 


Po ({( Xk)keN G R w 


ELifi 

}Too tf .-1 f ,s„}n(-oo,0))) N — 

k n ' 


Pa ({(Xk)k£N G AoP\Bo 


lim r l ( (#({h,- ,gn}n(-OO,0]) ) 

n—too n 


£1 

lim 

n—too 


Po ({( x k)k£N G Ao 0 Bo 


lim $ 1 ( 

n—>oo 


(#({£!,■■■ ,Xn} O (-00,0]) 


) 



n 
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Table 3 

Estimates of an unknown standard deviation a = 5 


n 

Sn 

Sn 

± n 

x n 

200 

4.992413159 

5.004941192 

5.205401325 

4.895457577 

400 

4.992413159 

5.004941192 

5.141812921 

4.835655399 

600 

5.10523925 

5.109498942 

5.211046737 

4.855457413 

800 

5.106390271 

5.109584761 

5.19369988 

4.92581015 

1000 

5.066642282 

5.069177505 

5.028142523 

4.944169095 

1200 

5.072294934 

5.074409712 

5.235885276 

4.935995814 

1400 

5.081110418 

5.082926073 

5.249446371 

4.96528786 

1600 

5.079219075 

5.080807075 

5.205452797 

4.9564705 

1800 

5.060850283 

5.06225666 

5.207913228 

4.963326232 

2000 

5.063112113 

5.064378366 

5.239119585 

4.981223889 


Ha {{{ X k)k£N £ : 


lim ,Xn} n (-00,0]) 

n—foo n 


= *(«,a)(0)}) = 


^(A a nB a ) = 1 . ( 5 . 23 ) 

( 3 ) 

The latter relation means that T ) 0 is an infinite-sample consistent estimate of 
a parameter a for the family of measures {Ha)a>o- 
This ends the proof of the theorem. 

□ 


Example 5.8. Since a sequence of real numbers (tt x n— [tt x n]) ra eiv, where [•] 
denotes an integer part of a real number, is uniformly distributed on (0,1 )(see, 
[10], Example 2.1, p.17), we claim that a simulation of a p.^ 3 5 yequidistributed 
sequence ( x n ) n <M on R(M is a ’’sufficiently large” natural number and depends 
on a representation quality of the irrational number n), where H( 3 , 5 ) denotes a a 
linear Gaussian measure with parameters (3, 5), can be obtained by the formula 

x n = $(3^s )(tt x n - [tt x n]) (5-24) 

for n < M, where denotes a Gaussian distribution function with param¬ 

eters (3,5). 

Suppose that we know a mean a = 3 and want to estimate an ’’unknown” 
standard deviation a. 

We set: n - the number of trials; S n - a square root from the sample vari¬ 
ance; S n - a square root from the corrected sample variance; - an estimate 
defined by the formula (5.13); T) - an estimate defined by the formula (5.19); 
a - an unknown standard deviation. 

The numerical data placed in Table 3 were obtained by using Microsoft Excel. 
Notice that results of computations presented in Table 3 show us that both statis- 

( 2 ) ( 3 ) 

tics Tn ' and Tf ; work correctly. Unfortunately, we can not present the results 
of computations for the statistics Tn' 1 defined by the formula (5.10) because it 
needs a quite exact calculations. 

At end of this section we state the following 
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Problem 5.5. Let T> be a class of positive continuous probability densities and 
Pf be a Borel probability measure on R with probability density function f for 
each f £T>. Does there exist an objective (or a subjective) infinite sample con¬ 
sistent estimate of an unknown probability density function f for the family of 
Borel probability measures {pJ : f £ D)}? 

6. On orthogonal statistical structures in a non-locally-compact 
Polish group admitting an invariant metric 

Let G be a Polish group, by which we mean a separable group with a complete 
invariant metric p (i.e., p(fh\g,fh 2 g) = p(h\,h 2 ) for each f,g,h\,h 2 £ G) for 
which the transformation (from G x G onto G), which sends (x,y) into x~ 1 y is 
continuous. Let B(G) denotes the er-algebra of Borel subsets of G. 

Definition 6.1. [12] A Borel set X C G is called shy, if there exists a Borel 
probability measure p over G such that p(fXg) = 0 for all /, g £ G. A measure 
p is called a testing measure for a set X. A subset of a Borel shy set is called 
also shy. The complement of a shy set is called a prevalent set. 

Definition 6.2. [1] A Borel set is called a Haar ambivalent set if it is neither 
shy nor prevalent. 

Remark 6.3. Notice that if X C G is shy then there exists such a testing 
measure p for a set X which has a compact carrier K C G(i.e. p(G \ K) = 0). 
The collection of shy sets constitutes an u-ideal, and in the case where G is 
locally compact a set is shy iff it has Haar measure zero. 

Definition 6.4. If G is a Polish group and {pg : 9 £ 0} is a family of Borel 
probability measures on G, then the family of triplets {(G,B,pg) : 9 £ 0}, 
where 0 is a non-empty set equipped with an a algebra L(0) generated by 
all singletons of 0, is called a statistical structure. A set 0 is called a set of 
parameters. 

Definition 6.5. (O) The statistical structure {(G, 13(G), pg) : 9 £ 0} is called 
orthogonal if the measures pg 1 and pg 2 are orthogonal for each different param¬ 
eters 9 1 and 82 . 

Definition 6.6. (WS) The statistical structure {(G,B(G),pg) : 9 £ 0} is 
called weakly separated if there exists a family of Borel subsets {Xg : 8 £ 0} 
such that pg 1 (Xg 2 ) = 6 ( 81 , 82 ), where <5 denotes Kroneckers function defined on 
the Cartesian square 0 x 0 of the set 0. 

Definition 6.7. ( SS ) The statistical structure {(G,B(G), pg) : 9 £ 0} is called 
strong separated (or strictly separated) if there exists a partition of the group G 
into family of Borel subsets {Xg : 9 £ 0} such that pg(Xg) = 1 for each 8 £ 0. 

Definition 6.8. (C£) A (B(G), L(0))-measurable mapping T : G —> 0 is called 
a consistent estimate of an unknown parameter 9 £ 0 for the statistical structure 
{(G,B(G), pg) : 9 £ 0} if the condition pg(T~ 1 (9)) = 1 holds true for each 
8 £ 0 . 
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Definition 6.9. ( (DCS ) A (B(G), L(0))-measurable mapping T : G —> 0 is 
called an objective consistent estimate of an unknown parameter 9 £ 0 for the 
statistical structure {(G,B(G), fig) : 9 £ 0} if the following two conditions hold: 

(i) fig(T~ 1 (9)) = 1 for each 9 £ 0; 

(ii) T~ 1 (9) is a Haar ambivalent set for each 0 6 0. 

If the condition (i) holds but the condition (ii) fails, then T is called a sub¬ 
jective consistent estimate of an unknown parameter 9 £ 0 for the statistical 
structure {(G,B,fig) : 9 £ 0}. 

Definition 6.10. ( SOC £) An objective consistent estimate T : G —> 0 of an 
unknown parameter 9 £ 0 for the statistical structure {(G,B(G), fig) : 9 £ 0} 
is called strong if for each 9 \, 0 2 £ © there exists an isometric Borel measurable 
bijection A^g lS ^ : G —>• G such that the set A( ei!02 )(T” 1 (0i))AT _1 (0 2 ) is shy 
in G. 

Remark 6.11. Let G be a Polish non-locally-compact group admitting an invari¬ 
ant metric. The relations between statistical structures introduced in Definitions 
6.5-6.10 for such a group can be presented by the following diagram: 

SOC£ -> (DCS -► CS^SS -> WS -»■ O (6.1) 

To show that the converse implications sometimes fail we consider the fol¬ 
lowing examples. 

Example 6.12. ](W<S <— O) Let F C G be a closed subset of the cardinality 
2 n ° . Let cj>: [0,1] — > F be a Borel isomorphism of [0,1] onto F. We set fi(X) = 
X(<p~ 1 (X D F)) for X £ B(G), where A denotes a linear Lebesgue measure on 
[0,1]. We put 0 = F. Let fix 9 o £ 0 and put: fig = fi if 9 = 9q, and fig = 5e|s(G)> 
otherwise, where Sg denotes a Dirac measure on G concentrated at the point 
9 and |s(c?) denotes the restriction of the Sg to the class B(G). Then the 
statistical structure {(G, B , fig) : 9 £ 0} stands O which is not W6>. 

Example 6.13. (SM) ](«S<5> •<— V9S) Following [15](see, Theorem 1, p. 335), 
in the system of axioms (ZFC) the following three conditions are equivalent: 

1) The Continuum Hypothesis (c = 2^° = Hi); 

2) for an arbitrary probability space (E; S; fa), the fi-measure of the union of 
any family (Ei)i^j of fi-measure zero subsets, such that card(I) < c, is equal to 
zero; 

3) an arbitrary weakly separated family of probability measures, of cardinality 
continuum, is strictly separated. 

The latter relation means that under Continuum Hypothesis in ZFC we have 
SS •<— WS. This is just Skorohod well known result (see, [26]). Moreover, fol¬ 
lowing [15] (see Theorem 2, p.339), if(F,p) is a Radon metric space and ( fi%)iei 
is a weakly separated family of Borel probability measures with card(I) < c, then 
in the system of axioms (ZFC)Sz(MA), the family (fii)i^i is strictly separated. 

Let consider a counter example to the implication SS 4— W5 in the Solovay 
model (SM) [25] which is the following system of axioms: (ZF)+DC + ’’ev¬ 
ery subset of the real axis R is Lebesgue measurable”, where ( ZF ) denotes the 
Zermelo-Fraenkel set theory and (DC) denotes the axiom of Dependent Choices. 
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For 9 £ (0; 1) , let bg be a linear classical Borel measure defined on the set 
{6} x (0;1). For 9 £ (1.2), let bg be a linear classical Borel measure defined 
on the set (0; 1) x {9 — 1}. By A g we denote a Borel probability measure on 
(0; 1) x (0; 1) produced by bg, i.e., 

(VX)(V0i)(V02)(* € B((0 ; 1) x (0; 1)) & 9 X £ (0; 1) & 9 2 £ (1; 2) 

A 9l (X) = b 8l (({ 0 ,} x (0; l))nl) & A e2 (X) = bg 2 (((0; 1) x { 0 ,- 1}) nX)). (6.2) 
If we put 9 = (0; 1) U (1; 2), then we get a statistical structure 

((0; 1) x (0;l),B((0;l)x (O;l)),A 0 ) eee . (6.3) 

Setting Xg = {9} x (0; 1) for 9 £ (0; 1), and Xg = (0; 1) x {9 — 1} for 9 £ (1.2), 
we observe that for the family of Borel subsets {Xg : 9 £ 0} we have A 8l (Xg 2 ) = 
^(d\,9f), where S denotes Kroneckers function defined on the Cartesian square 
0x0 of the set 0. In other words, (A g)g^Q is weakly separated. Now let assume 
that this family is strong separated. Then there will be a partition {Yg : 6 £ 0} 
of the set (0; 1) x (0; 1) into Borel subsets (Yg)g e © such that A g(Yg) = 1 for 
each 9 £ 0. If we consider A = U 0 £(o ; i)le and B = U 06 (i ; 2 )Ve then we observe 
by Fubini theorem that I 2 (A) = 1 and I 2 (B) = 1, where t 2 denotes the 2- 
dimensional Lebesgue measure defined in (0; 1) x (0; 1). This is the contradiction 
and we proved that (A g)g<=e is not strictly separated. An existence of a Borel 
isomorphism g between (0; 1) x (0; 1) and G allows us to construct a family 
(ixg)g^Q in G as follows: pg(X) = A g(g~ 1 (X)) for each X £ B(G ) and 9 £ 
0 which is W<S but no SS (equivalently, C£). By virtue the celebrated result 
of Mycielski and Swierczkowski (see, [11]) asserted that under the Axiom of 
Determinacy (AD) every subset of the real axis R is Lebesgue measurable, the 
same example can be used as a counter example to the implication SS ■£- WAS in 
the theory (Z F)+(DC)+(AD). Since the answer to the question asking ’’whether 
(fXg)g^Q has a consistent estimate?” is yes in the theory ( ZFC ) & ( CH ), and 
no in the theory (ZF) + (DC) + (AD), we deduce that this question is not 
solvable within the theory (ZF) + (DC). 

Example 6.14. ](OC£ £- C£) Setting 0 = G and /xg = Sg\B(G) for 9 £ 0, 
where Sg denotes a Dirac measure in G concentrated at the point 9 and 5g\B(G) 
denotes its restriction to B(G), we get a statistical structure (G, B(G), pg)g^Q. 
Let L(Q) denotes a minimal a-algebra of subsets ofQ generated by all singletons 
of 0. Setting T(g) = g for g £ G, we get a consistent estimate of an unknown 
parameter 9 for the family (pg)g^Q. Notice that there does not exist an objective 
consistent estimate of a parameter 9 for the family (pg)g^Q. Indeed, if we assume 
the contrary and T\ be such an estimate, we get that T(~ 1 (9) is a Haar ambivalent 
set for each 9 £ 0. Since T\ is a consistent estimate of an unknown parameter 
9 for each 9 £ 0, we get that the condition pig(T(f 1 (9)) = 1 holds true which 
implies that 9 £ T ] f 1 (9) for each 9 £ 0. Let fix any parameter 9 q £ 0. Since 
Tr\9o) is a Haar ambivalent set there is 9\ £ T{f 1 (9o) which differs from 9 q. 
Then T{~ 1 (9 q) and Tf 1 (9\) are not disjoint because 9\ £ Tf 1 (9o) nTf 1 (9i) and 
we get the contradiction. 
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Remark 6.15. Notice that if (0,p) is a metric space and if in the Definition 
2.8 the requirement of a (23(G), L(0))-measurability will be replaced with a 
(23(G), 23(0))-measurability, then the implication SS —>■ C£ may be false. In¬ 
deed, let G be a Polish group and f : G <— 0(:= G ) be a non-measurable(in 
the Borel sense) bijection. For each 9 £ 0 denote by pg the restriction of the 
Dirac measure 6f(g) to the a-algebra of Borel subsets of the group G. It is clear 
that the statistical structure {(G,B(G), pg) : 9 £ 0} is strictly separated. Let 
show that there does not exist a consistent estimate for that statistical struc¬ 
ture. Indeed, let T : G —> 0 be (23(G), 23(0))-measurable mapping such that 
pg({x : T(x) = 0}) = 1 for each 9 £ 0. Since the measure fig is concentrated at 
the point f(9) we have that f(9) £ {x : T(x ) = 0} for each 9 £ 0 which implies 
that T(f(9)) = 6 for each 9 £ 0. The latter relation means that T = / -1 . 
Since / is not (13(G), 23(0))-measurable, we claim that / -1 = T is not also 
(B(G), 2?(0))-measurable and we get the contradiction. 

There naturally arises a question asking whether there exists such a statistical 
structure {(G,23, fig) : 9 £ 0} in a Polish non-locally-compact group admitting 
an invariant metric which has an objective consistent estimate of a parameter 
9. To answer positively to this question, we need the following two lemmas. 

Lemma 6.16. ([24], Theorem, p.206) Assume G is a Polish, non-locally-compact 
group admitting an invariant metric. Then there exists a closed set F C G and 
a continuous function (j> : F —> 2 N such that for any x £ 2 N and any compact 
set K C G there is g £ G with gK C ip~ 1 (x). 

Lemma 6.17. ([5], Proposition 12, p.87 ). Let G be a non-locally-compact 
Polish group with an invariant metric. Then any compact subset (and hence 
any K a subset) of G is shy. 

Remark 6.18. In [19] (see proof of Theorem 4.1, Step 2) has been constructed a 
partition $ = { Ag : 9 £ [0,1]} of the R w into Haar ambivalent sets such that for 
each 0i,02 G [0,1] there exists an isometric( with respect to Tychonoff metric 
which is invariant under translates) Borel measurable bijection A^g 1 g 2 j of R^ 
such that A(g 1 p 2 ^(Ag 1 )AAg 2 is shy. In this context and concerning with Lemma 
6.16 it is natural to ask whether an arbitrary Polish non-locally-compact group 
with an invariant metric admits a similar partition into Haar ambivalent sets. 
Notice that we have no any information in this direction. 

Theorem 6.19. Let G be a Polish non-locally-compact group admitting an in¬ 
variant metric. Then there exists a statistical structure {(G,B,pg) : 9 £ 0} in 
G which has an objective consistent estimate of a parameter 9 such that: 

(i) 0 C G and card(0) = 2^°; 

(ii) pg is the restriction of the Dirac measure concentrated at the point 9 to 
the Borel cr-algebra 23(G) for each 9 £ 0. 

Proof. By virtue of Lemma 6.16, there exists a closed set F C G and a continu¬ 
ous function (f> : F —> 2 N such that for any x £ 2 N and any compact set K C G 
there is g £ G with gK C cf>~ 1 (x). For x £ 2 N \ {(0,0, ■ • •)} we put 

X x = (]- 1 (x). 


(6.4) 
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We set X (0)0 ,...) = </> -1 (( 0,0, •••)) U ( G\F ). Thus we have a partition {X x : 
x € 2 N } oi G into Borel subsets such that each element of the partition is Borel 
measurable and Haar ambivalent set. Let { 9 X : x £ 2^} be any selector. We 
put 0 = {9 : 9 = 9 X for some x £ 2 N } and denote by gg the restriction of the 
Dirac measure concentrated at the point 9 to the a- algebra 13(G). Thus we have 
constructed a statistical structure {(G,B,gg) : 9 £ 0} in G. We put T(g) = 9 
for each g £ Xg. Now it is obvious that T is the objective consistent estimate of 
a parameter 6 for the statistical structure {(G, B,gg) : 9 £ 0} in G such that 
the conditions (i)-(ii) are fulfilled. □ 

Theorem 6.20. Let G be a Polish non-locally-compact group admitting an in¬ 
variant metric. Let g be a Borel probability measure whose carrier is a com¬ 
pact set Kq( i.e., g(G \ Kq) = 0). Then there exists a statistical structure 
{(G,B,gg) : 9 £ 0} in G which has an objective consistent estimate of a pa¬ 
rameter 9 such that 

(i) 0 Q G and card(Q) = 2^°; 

(ii) gg is a 9-shift of the measure g (i.e. gg(X) = g(9~ 1 X) for X £ B(G) 
and 9 £ &). 

Proof. By virtue of Lemma 6.16, there exists a closed set F C G and a con¬ 
tinuous function (f> : F —> 2 N such that for any x £ 2 N and any compact set 
K C G there is g £ G with gK C (f~ 1 (x ). For x £ 2 N \ {(0, 0, • • •)} we put 
X x = (f~ 1 (x). We set X( 0 ,o,-..) = </> _1 ((0,0, • • •)) U ( G\F ). Thus we have a 
partition {X x : x £ 2^} of G into Borel subsets such that each element of the 
partition is Borel measurable, Haar ambivalent set and for any x £ 2 N and any 
compact set K C G there is g £ G with gK C X x . If we take under K a set 
K 0 , then for any x £ 2 N there is g(K 0 ,x ) £ G with g(K 0 ,x)Ko C X x . We 
put 0 = {9 : 9 = g(K 0 ,x) & x £ 2^}. For each 9 £ 0 and X £ B(G), we 
put gg(X) = g(9~ 1 X). For g £ X x we put T(g ) = g(I\ 0l x). Let us show that 
T : G —> 0 is an objective consistent estimate of a parameter 9. Indeed, on the 
one hand, for each 9 £ 0 we have 

ge(T~ l (9)) = g g{KotX) (T~ l (g(K 0 ,x))) = g g{KotX) (X x ) = g(g(K 0 , x)~ l X x ) > 

g(g(K 0 ,x)~ 1 g(K 0 ,x)K 0 ) = g(K 0 ) = 1, (6.5) 

which means that T : G —>• 0 is a consistent estimate of a parameter 9. On 
the other hand, for each 9 = g(Ko,x) £ 0 we have that a set T~ 1 (9) = 
T~ l (g(KQ,x)) = X x is Borel measurable and a Haar ambivalent set which to¬ 
gether with the latter relation implies that T : G —> 0 is an objective consistent 
estimate of a parameter 9. Now it is obvious to check that for the statistical 
structure {(G,B,gg) : 9 £ 0} the conditions (i)-(ii) are fulfilled. □ 

The next theorem shows whether can be constructed an objective consistent 
estimates by virtue of some consistent estimates in a Polish non-locally-compact 
group admitting an invariant metric. 

Theorem 6.21. A ssume G is a Polish, non-locally-compact group admitting 
an invariant metric. Let card(Q) = 2^° and T : G —» 0 be a consistent estimate 
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of a parameter 9 for the family of Borel probability measures (pg)g^e such that 
there exists do € 0 for which T~ 1 (9 q ) is a prevalent set. Then there exists an 
objective consistent estimate of a parameter 6 for the family (pg)g^Q. 

Proof. For 0 £ 0 we put Sg = T~ 1 (9). Since Sg 0 is a prevalent set we deduce 
that 

Ueee\{0o} Ss ~ \ Se 0 (6.6) 

is shy in G. 

By Lemma 2.6 we know that the measure pg 0 is concentrated on a union of 

(f) } 

a countable family of compact subsets {Ft 0 : k £ Nj. By Lemma 6.7 we know 
that Ufcgjvi^ 00 ^ is shy in G. 

We put Sg = Sg for 9 £ 0 \ {0 O } and Sg 0 = U keN F^°. Clearly, S = U g e &Sg 
is shy in G. 

By virtue of Lemma 6.16, there exists a closed set F C G and a continuous 
function f> : F —> 2 N such that for any x £ 2 N and any compact set K C G 
there is g £ G with gK C </> _1 (x). Let / : 2 N —> 0 be any bisection. For 9 € 0 
we put 


Bg = (r 1 (f~\0))\S)USg. (6.7) 

Notice that (Bg)g G Q is a partition of G into Haar ambivalent sets. We put 
T\{g) = 9 for g £ Bg(9 £ 0). Since 

gtg(T^\9)) = pg(B e ) > p e (S 0 ) = 1 (6.8) 


for 9 £ 0, we claim that T\ is a consistent estimate of a parameter 9 for the 
family (pg)g G Q. Since T 1 _1 (0)) = Bg is a Borel and Haar ambivalent set for each 
9 £ 0 we end the proof of the theorem. □ 

Example 6.22. Let F be a distribution function on R such that the integral 
f R xdF(x ) exists and is equal to zero. Suppose that p is a Borel probability 
measure on R defined by F. For 9 £ ©(:= R), let pg be 9-shift of the measure 
p(i.e., pg(X) = p(X — 9) for X £ £>(R),). Setting, G = R^, for 9 £ 0 we 
put pg = pN, where denotes the infinite power of the measure pg. We set 

T({x k ) ke jv) = lim^oo ^ k = lJk , i/lim^oo — exists, is finite and differs 
from the zero, and T((x k )k£N) = 0; otherwise. Notice that T : R*^ 0 is a 

consistent estimate of a parameter 9 for the family (pg)g G Q such that T -1 (0) 
is a prevalent set. Indeed, by virtue the Strong Law of Large Numbers, we know 
that 

P8{{{x k )keN ■ lim — fc=1 Xk =9} = 1 (6.9) 

n—too Ji 

for 9 £ 0. 

Following [18] (Lemma j.lf, p. 60), a set S defined by 


S = {(x k ) ke N 


lim 

n—> oo 


E n 

k= 1 


Xk 


exists and is finite }, 


n 


( 6 . 10 ) 
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is Borel shy set, which implies that H N \ S is a prevalent set. Since R Y \ S C 
T -1 (0), we deduce that T _1 (0) is a prevalent set. Since for the statistical struc¬ 
ture {(R w , S(R W ), pg) : 9 £ 0} all conditions of the Theorem 6.21 are fulfilled, 
we claim that there exists an objective consistent estimate of a parameter 9 for 
the family (p e ) e& Q. 

Notice that in Theorem 4.1 (see also [19], Theorem 3.1, p. 117) has been 
considered an example of a strong objective infinite sample consistent estimate 
of an unknown parameter for a certain statistical structure in the Polish non- 
locally compact abelian group R w . In context with this example we state the 
following 

Problem 6.1. Let G be a Polish non-locally-compact group admitting an in¬ 
variant metric. Does there exist a statistical structure {(G,B(G), pg) : 9 £ 0} 
with card(Q) = 2 N ° for which there exists a strong objective consistent estimate 
of a parameter 9 ? 

7. On objective and strong objective consistent estimates of an 
unknown parameter in a compact Polish group {0,1}^ 

Let Xi, X 2 , ■ • ■ , X}., ■ ■ ■ be an infinite sample obtained by coin tosses. Then the 
statistical structure described this experiment has the form: 

{({O,l} JV ) B({O,l} JV ),^):0e(O,l)} (7.1) 

where /^({l}) = 9 and /^({O}) = 1 — 9. By virtue of the Strong Law of Large 
Numbers we have 

^~\n 

tfttfrkheN ■■ (xk)keN £ {0,1}* & lim = 6}) = 1 (7.2) 

n—> oo 77 , 

for each 9 £ (0,1). 

Notice that for each k £ N, Gk = {0,1} can be considered as a com¬ 
pact group with an addition group operation (mod 2). Hence the space of 
all infinite samples G := {0,1} W can be presented as an infinite product of 
compact groups {Gk : k £ N}, i.e. G = II/oeAr Also, that the group 
G admits an invariant metric p which is defined by p({xk)keN, (yk)k&N) = 

J2keN 2 fe+1 — yfc Q (nfod 2 )|) for ( x k)keN, (? Jk)keN £ G. It is obvious that the 

measure X k on Gk defined by Afc({0}) = Afc({l}) = 1/2 is a probability Haar 
measure in Gk for each k £ N and for the probability Haar measure A in G the 
following equality A = J} fceAr Afc holds true, equivalently, A = /Jq /. 

By virtue (7.2) we deduce that the set 

^~^,n 

H(0, 5) = {(x fe ) fceJV : (xk)k&N £ {0,1}* & lim ^ k=1 Xk = 0, 5} (7.3) 

n—»■ oo 77, 

is prevalence. Since A(9) C G \ H(0, 5) for each 9 £ (0; 1) \ {1/2}, where 

A(9) = {{x k ) k &N ■ (a’fc)fc G iv £ {0,1} W & lim — k=1 X ' k = 9}, (7.4) 

n—>oo 77, 
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we deduce that they all are shy(equivalently, of Haar measure zero) sets. In 
terms of [7], this phenomena can be expressed in the following form. 

Theorem 7.1. For ’’almost every” sequence (xk)k&N £ {0,1}^ its Cezaro 
Xk 

means ( • k z 1 —) ra eiv converges to 0,5 whenever n tends to oo. 

By virtue the Strong Law of Large Numbers, we get 


Theorem 7.2. Let fix 6 0 £ (0,1). For each (xk)keN £ G, we set T((xk)keN) = 
Y* Xk 

lim n ^oo — */ ^is limit exists and differs from 9 q, and T((xk)keN) = 9q, 
otherwise. Then T is a consistent estimate of an unknown parameter 6 for the 
statistical structure {(G,B(G), pig) : 9 £ 0}. 


Remark 7.3. Following Definition 6.9, the estimate T is subjective because 
T _1 (l/2) is a prevalent set. Unlike Theorem 6.21, there does not exist an objec¬ 
tive consistent estimate of an unknown parameter 9 for any statistical structure 
{(G,B(G), pig) : 9 £ 0} for which card(0) > H 0 , where H 0 denotes the cardinal¬ 
ity of the set of all natural numbers. Indeed, assume the contrary and let Tj be 
such an estimate. Then we get the partition {Tjf 1 (9) : 9 £ 0} of the compact 
group G into Haar ambivalent sets. Since each Haar ambivalent set is of positive 
A-measure, we get that the probability Haar measure A does not satisfy Suslin 
property provided that the cardinality of an arbitrary family of pairwise disjoint 
Borel measurable sets of positive A-measure in G is not more than countable. 
Remark 7.4. Let consider a mapping F : G —> [0,1] defined by F{{xk)keN) = 
12keN W f° r ( x k)keN £ G. This a Borel isomorphism between G and [0,1] 
such that following equality A(X) = £±(F(X)) holds true for each X £ B(G). 
By virtue the latter relation, for each natural number to, the exists a partition 
{Xk : 1 < k < m} of the group G into Haar ambivalent sets such that for each 
1 < * < j < to there is an isometric Borel measurable bijection f(i t j) : G —> G 
such that the set f( it j)(Xi)AXj is shy, equivalently, of the A-measure zero. 

By the scheme presented in the proof of the Theorem 6.21, one can get the 
validity of the following assertions. 

Theorem 7.5. Let 0i be a subset of the 0 with card(Q) > 2. Then there exists 
an objective consistent estimate of an unknown parameter 9 for the statistical 
structure {(G,B(G), pig) : 9 £ 0i} if and only if card{& i) < Ho and 1/2 ^ 0i. 

Theorem 7.6. Let 02 be a subset of the 0 card(Q) > 2. Then there exists a 
strong objective consistent estimate of an unknown parameter 9 for the statistical 
structure {(G,B(G), pig) : 9 £ © 2 } if and only if card(& 2 ) < ^0 cmd 1/2 ^ © 2 . 
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